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We consider the relationship between correlations and entanglement in gapped quantum systems, 
with application to matrix product state representations. We prove that there exist gapped one- 
dimensional local Hamiltonians such that the entropy is exponentially large in the correlation length, 
and we present strong evidence supporting a conjecture that there exist such systems with arbitrarily 
large entropy. However, we then show that, under an assumption on the density of states which is 
believed to be satisfied by many physical systems such as the fractional quantum Hall effect, that 
an efficient matrix product state representation of the ground state exists in any dimension. Finally, 
we comment on the implications for numerical simulation. 

Finding the ground state of a local quantum Hamiltonian is one of the basic problems in physics. Efficient numerical 
techniques, however, only exist for certain special cases. Quantum Monte Carlo, for example, is most effective for 
systems which lack a sign problem. Fortunately, in one dimension, the extremely powerful Density Matrix Renormal- 
ization Group (DMRG) 1] algorithm is available, at least for systems with an excitation gap. This algorithm is based 
ultimately on knowledge of the structure of the ground state: it is not an arbitrary wavefunction but rather has the 
special form of a a matrix-product state [2J. Recently, a very promising algorithm capable of finding higher-dimensional 
matrix product states to approximate the ground state of fairly arbitrary Hamiltonians has been developed and 
appears to offer, at least for certain systems, the possibility of studying systems that cannot be attacked by any other 
numerical technique. 

All this work raises the important question: are ground states of such gapped, local quantum systems indeed close 
to matrix product states? A basic consequence of such a description is an area law: the reduced density matrix of the 
ground state wavefunction on some subvolume of the entire system has an entropy that is bounded by some constant 
times the surface area of that volume, while critical systems in one dimension may exhibit logarithmic corrections [ij]. 
One advance^, Q was to show that for all such Hamiltonians, the Hamiltonian could be written as a sum of local 
terms such that the ground state wavefunction was close to an eigenvector of each term separately, allowing one to 
use certain generalized matrix product states. Unfortunately, these states required a hierarchical construction, joining 
blocks of the system together at successively longer length scales, and hence do not provide a construction of the 
desired local matrix product states. Further this work left open the question of the number of such states required in 
each block, precisely the question of whether an area law holds or not. 

Let X, Y be sets of sites in the system. An area law would follow from the assumption that the reduced ground 
state density matrix of the system pxuY on the set of sites X UY approximately factorizes into a product of density 
matrices, px ®Py, ii X,Y are separated by some distance from each other, as discussed in the Appendix. As a partial 
result to showing this factorization, it was shown that a gapped system with a local Hamiltonian has exponentially 
decaying correlations 0, Q, and so for any operators Ox,Oy with support on X, Y we have Tt:(OxOyPxuy) ~ 
Tt(OxOyPx <8> Py), up to exponentially small corrections in the distance between X and Y. However, the exponential 
decay of correlations functions is not directly useful in showing the factorization of density matrices, as there are 
so-called "data hiding" states on bipartite systems for which correlations are very small despite a high degree of 
entanglement [9|, |K| . 

In this paper, we study this question of the entanglement entropy, for a gapped system with a local Hamiltonian. We 
prove that there exist one-dimensional systems for which this entropy is exponentially large in the correlation length. 
Further, we present evidence to support a conjecture that for any, arbitrarily large, S there exist one-dimensional 
systems with an entanglement entropy equal to S, and with a Hilbert space dimension on each site D equal to 3 or 
4 and a correlation length bounded above by some S'-independent constant of order unity. Still, all these systems 
involve long-range interactions so that the entropy is still of order log(D) times the Lieb-Robinson group velocity [l3T| 
divided by the energy gap. 

However, under a certain assumption on the density of states believed to be satisfied by many important physical 
systems such as the 1/3 fractional Hall effect (in this case defined for a lattice system of electrons), we show that 
systems in arbitrary dimensions can be efficiently represented as higher dimensional matrix product states. This 
result is based on a recent result [5j, that the density matrix at a nonzero temperature can be represented as a matrix 
product density matrix (Tl|. 
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I. ONE DIMENSIONAL MODEL SYSTEM AND THE EXPANDER GRAPH STATE 

In this section, we construct the one dimensional model systems described above. Following [2I [l2| . we construct the 
system by first writing its ground state as a matrix product, and then defining the Hamiltonian as a sum of projection 
operators. We write the ground state for this V site system as 

s 2 , 8 V ) = Tr(A( Sl )A(s 2 )...A( Sy )) , (1) 

where 1 < Sj < D is the state of the system on site i and where the A(si) are fc-by-fc dimensional matrices, with fc 
denoting the dimension of the matrix product state. We normalize so that 

f>( S )At(,s) = l. (2) 

s=l 

This state ([I]) is the ground state of a Hamiltonian, H = P;,i+i, where Pi,i+i j+j projects onto the set of 
states on sites i,i + + l defined by ^ a ,p(s%, Si+i, sj) = S{ 7 } ^( s 0a7i^( s »+i)7i7 2 ■■■^( s i+/)7i/3, where 

^4(si)a7, with 1 < a, 7 < fc, are matrix elements of A(sj). Here, the interaction length I is of order log£)(fc)[il, [HI], an d 
hence the Lieb-Robinson|l 3f g roup velocity v of this system is of order I. 

A sufficient conditionally] for this Hamiltonian to have a unique ground state with a gap is that the linear map 
from k-by-k matrices to fc-by-fc matrices 

D 

£(M)=5>( S )M^( S ) (3) 

s=l 

have one nondegenerate eigenvalue equal to unity, and then have a gap to the next largest (in absolute value) 
eigenvalue. From Eq. ((2|), the eigenvector with unit eigenvalue is proportional to the unit matrix. 

We now propose a specific choice of the A(s) such that £(M) has a gap in its spectrum and such that k is 
exponentially large in D. We pick 

A(s) = ^=U(s), (4) 



where U(s) is a unitary matrix depending on s. Thus, Eq. ((2|) is automatically satisfied. We then pick U(s) following 
two different rules, one rule for 1 < s < D/2 and one for D/2 < s < D. 

For 1 < s < D/2, we pick U(s) to be a diagonal matrix with matrix elements 

U(s) a p = 8 a pF(a, s) (5) 

where F(a, s) is some function such that F(a, s) — ±1 for all a, s. We pick F(a, s) such that for any two a, j3 with 

D/2 

\J2F(a,s)F(/3,s)\<D/4, (6) 

s=l 

The question arises: for which values of fc and D is it possible to satisfy Eq. ©? Define the vector v a to be 
a vector in a D/2 dimensional vector space by v a = {F(a,l)/^/D^,F{a,2)/^/Dj2,...,F(a,s)/^fDj2), Then, to 
satisfy Eq. ([6|) we must find fc vectors v a in a D/2 dimensional vectors space such that the inner product between v a 
and V/3 is less than 1/2 for a and hence the angle between the vectors v a ,vp is greater than <fi = cos _1 (l/2). It 
is knownQ (3 

that for large D, it is possible to do this for fc < exp(cD/2) such vectors for some constant c > 0, 
and hence fc may be exponentially large in D. 

For D/2 < s < D, we pick U(s) to be the matrix with matrix elements 

^ fe-i 

U{s)a(3 = -j:J2 exp[2^a(a - p)/k]F(a, s), (7) 

a=0 

and we pick the F such that for any two a, b with a b, 

D 

I J2 Ha,s)F(b,s)\<D/4. (8) 

s=D/2+l 
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Again, this is possible to do so long as k < exp(cD/2). 

Eq. © implies that off-diagonal elements of M are reduced by the map £{M) while Eq. © implies that off-diagonal 
elements of M in the Fourier basis are also reduced by this map. We now use this idea to show that the map £(M) 
does indeed have a gap between the unit eigenvalue and the next largest eigenvalue. The completely positive map 
£{M) is a Hermitian linear operator from k-hy-k matrices to fc-by-fc matrices and hence the eigenvalue which is second 
largest in absolute value can be found by taking the maximum over all traceless matrices M with Tr(M 2 ) = 1 of 

|Tr(M£(M))|. Let £\(M) = E^M(*) MAt ( s ) and let £ ^ M ) = Ef=c/2+i A(s)MA^(s) so that £{M) = £\{M) + 
£%[M). Let Ma denote the diagonal part of such a matrix M and let Pd = Tr(Mj). Then, from Eq. ((6]), we have 
|Tr(M£i(M))| < P d /2+(l-P d )/A. Let M f be the matrix with elements Mf = (1/fc) Y, a p M <*0 exp[-27ri(aa-6/3)/fc] 
and let Mdf denote the diagonal components of this matrix Mf with P d f = Tr(M^). Then, from Eq. © we have 
|Tr(M£ 2 (M))| < Pdf/2 + (1 - Pd/)/4. However, for a traceless matrix M with Tr(M 2 ) = 1 we have P df < 1 - P rf . 
Therefore, for any traceless matrix M we have \Tt(M£(M))\ < 3/4, showing the existence of a gap as claimed. 

In the case of this construction, we showed that the correlation length is bounded by a constant, independent of 
D and k. For a sufficiently long chain, the entanglement entropy between two halves of the chain is equal to log e (fc). 
One can represent each site on this system with D states by log 2 (-D) sites with 2 states on each site. In this case, the 
correlation length of the system is of order log 2 (-D), while the entropy is of order log e (exp(cZ3/2)) = cD/2, which is 
exponentially large in the correlation length as claimed. 

This construction allows us to take k exponentially large in D and still have a gap in the spectrum of £(M), as 
claimed. We now present an alternative construction which gives an arbitrarily large k, along with evidence that it 
also leads to a gap in £[M). We take D = 4 and for s — 1, 2 we take the matrices U(s) to be of the form 

U(s) = P(s)a(s), (9) 

where c(s) is a diagonal matrix which entries equal to ±1, and P(s) is a permutation matrix (that is, it has exactly 
one zero in each row and column). We then take U(3) = U(ly and U(A) = U(2y. We set P(3) = P(ly and 
P(4) = P(2)L We now fix k at an arbitrary value and then argue that by an appropriate choice of P and a it is 
possible to have a gap in £(M). 

Let P(s, a) denote the value of j such that the matrix element P(s) a " = 1. That is, P(s, a) is the result of applying 
the given permutation to a. The operator £(M) is block diagonal: acting on a diagonal matrix it produces a diagonal 
matrix and acting on an off-diagonal matrix it produces an off-diagonal matrix. We study the spectrum of £(M) in 
each block separately, starting with the action on a diagonal matrix. Let M(a, (3) be the matrix with matrix elements 
M(a,0) aT = S acr 50 T . We have 

i 4 

£(M(a, a)) = -^2 M(P(s, a), P(s, a)). (10) 

s=l 

Eq. (|10p can by represented by a diffusion process on a graph. The graph has vertices labeled by a — l...k, and 
with an undirected edge from vertex a to (3 if for some s — 1,2 we have P(s,a) = (3 or P(s,/3) = a. This graph 
has fixed coordination number equal to 4, although some vertices may have more than one edge connecting them if 
for some s ^ t we have P(s,a) — P(t, a)[l7j]. Then, Eq. (fTU)) implies that in the first block, £{M) has the same 
spectrum as the 1/4 times the adjacency matrix of the given graph. However, it is known that it is possible to find 
graphs with k vertices and fixed coordination number q, for any q > 2, such that l/q times the adjacency matrix has 
a unit eigenvalue and then a gap to the next eigenvalue which is bounded below by some fc-independent constant fl6j. 
Indeed, it has been shown that the gap between the unit eigenvalue and the next eigenvalue of the adjacency matrix 
of a random graph generated using the above procedure with a random choice of permutations P is, with probability 
tending to unity as the size k of the graph tends to infinity, bounded below by some fc-independent constant (l8j|. 
Graphs with such a gap in the adjacency matrix spectrum are called expander graphs and we refer to the state with 
the appropriate choice of permutation matrices and diagonal matrices a(s) discussed below as the expander graph 
state. 

Now we consider the spectrum of £(M) in the second block. We have 

1 2 4 
£(M(a, (3)) = M (P(s, a), P(s, /3))a(s) aa a(s) fjp + ^ M (P(s, a), P(s, (3))a{s) P{s ^ )P{Sta) a{s) P{s ^ )P{StP) 

s—1 s—3 

(ii) 

While it is possible to prove the existence of a gap in the spectrum of £(M) in the first block for suitable matrices 
P, we have to apply some physical intuition to show that the second block has all eigenvalue separated from unity 
by a constant. If all the a(s) aa were equal to plus one, then the second block would have one unit eigenvalue, with 
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eigenvector proportional to a matrix with all off-diagonal entries equal to unity and all diagonal entries equal to zero. 
In this case, Eq. would describe two correlated random walks on the given graph, one for each index a, (3. Then, 
for a random choice of the permutations P, we would expect that, for similar reasons to the existence of a gap in the 
diagonal sector, there would typically be a gap to the next eigenvalue in the off-diagonal sector as any correlations 
between a, (3 would be short-lived under this random process. We instead randomly set each a(s) aa equal to ±1, 
independently for each a. In this case, we expect that random choices of the a and P will, due to the random 
signs, cause all eigenvalues in the second block to be separated from unity by at least some fc-independent gap with 
probability tending to unity as fc tends to infinity. 

We have tested this numerically, by generating random permutations and random a. We picked permutations 
with the additional restriction that each permutation had exactly one cycle of length fc. We performed tests on 
systems with k up to 50 and found that there was always one unit eigenvalue and a gap to the rest of the spectrum, 
with the most negative eigenvalue separated by a gap from —1, and further that the spectrum away from the unit 
eigenvalue exhibited a scaling collapse, in that the density of eigenvalues appeared to be roughly equal to k 2 times 
some fc-independent function. 

In the above, we considered D = 4 so that we could take the matrix U(3) = C/(l)t and C7(4) = f7(2)+ and arrive 
at a real spectrum for £(M). If we take D = 3, and choose U{s) = P(s)cr(s) for s = 1,2,3 with P(l), P(2), P(3) 
to be random permutations, and ct(1), cr(2), ct(3) random diagonal matrices with entries ±1, then for the first block 
of £ (M) we arrive at the adjacency matrix of a directed graph of degree 3. In this case, £ (M) may have a complex 
spectrum. However, we still expect there to be a gap. 



II. MATRIX PRODUCT STATES FROM THERMAL DENSITY MATRICES 

In this section, we build on the result in Q that it is possible, for local Hamiltonians to approximate the thermal 
density matrix by a matrix product operator to show, subject to an assumption on the density of states, that the 
ground state is close to a matrix product state. We start by considering the case of a unique ground state and a gap 
AE to the next excited state and then generalize to multiple ground states. The idea is as follows: we approximate the 
thermal density matrix, Z^ 1 exp[— j3H] for a Hamiltonian H , with Z = Tr(exp[— /3H]), by a matrix product density 
operator up to some small error in trace norm. For large enough (3, the thermal density matrix becomes a good 
approximation in operator norm to po — , 5o)(^ / o, the projector onto the ground state of the given Hamiltonian. 
We then make an assumption on the number of low energy states of the Hamiltonian which then allows to show that 
the thermal density matrix is a good approximation in trace norm to the projector, and hence that our matrix product 
operator is a good approximation in trace norm to the projector. This means that in any complete orthonormal basis 
there must exist some state such that the matrix product operator acting on the basis is close to the ground state; 
picking this basis to be a factorized basis gives us a matrix product state which is close to the ground state. 

We consider a regular lattice (this condition can be weakened to include other lattices) of V sites labeled 1, 2, .., V, 
with a metric d(i, j) between sites i,j and we consider a Hamiltonian H which is a sum of terms Hi supported on the 
sites within distance R of i for some range R and with operator norm bounded by some constant J. Then, it 

was shown that for any e and for any regular d-dimensional lattice of V sites, there exists a matrix product density 
operator approximation to the thermal density matrix of the form 

p((3,l pro j) = Pi{ai)p2(a 2 )---Pv(av)F 1 {{a j })F 2 ({a :j })...F v ({a :j }), (12) 

where Tr(p(P,l pro j)) — 1, where each operator pi{ai) acts only on site i, where the atj are some set of indices, with 
range 1 < a j < a max for all j, and where each function F{ depends only on the otj with d{i,j) < lproj, and such that 

Tr(|p(/3, l proj ) - Z^exph&H]!) < e (13) 
where Tr(|...|) denotes the trace norm, and where 

l proj - Rlog(V/3/Je), (14) 
with the constant of proportionality depending on the exact lattice structure, and with 

a max ~ D l t^/ J . (15) 

Now, we want to introduce a condition on the density of states of a given Hamiltonian that will lead to a bound 
on how accurately the thermal density matrix approximates the ground state projection operator. To motivate this 
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bound, suppose that we have a Hamiltonian of the following particularly simple form: H = AEj^i 0%, where L is 
an operator on site i with one zero eigenvalue and D — 1 eigenvalues equal to unity. Then, there exists one state, 
with all spins down, with energy 0. There exist (D — 1)V states, each with one spin up, with energy AE. There exist 
(D — 1) 2 V(V — l)/2 states with energy AE/2, and so on. Thus, we have the bound that p(m), which we define to be 
the number of states with energy Ei with mAE < Ei < (m + l)AE, obeys 

p(m) < (cV) m /m\, (16) 

for c = D-l. 

In general, however, many gapped systems will obey assumption (|16p for some constant c. All free fermion systems 
with a gap in the single particle spectrum will obey this assumption. Physically, we expect that a lattice realization 
of the fractional Hall effect at an incompressible filling fraction will also obey this. In the rest of this section, we 
show that if a system does obey this assumption, then it is possible to write the ground state as a higher-dimensional 
matrix product state, providing bounds on the error as a function of the dimension of the matrix product state. Using 
this assumption, 

oo 

TrdZ" 1 exp[-/3H] - p \) < 2 ^ (exp[-/3AE]cV) m /ml = 2(exp{exp[-/3A£]cU} - 1), (17) 

m=l 

and hence for any e, for j3 > log(cV/log(l + e/2))/AE, we have 

Trd^exphSifJ-pol)^ e. (18) 

The operator p(/3, l pro j) can be written in the form p(/3, l pro j) — 0^0 for some operator O. We write an orthonormal 
basis of states for the system by vectors \E'c), where v = (v%,V2, ■-, vy) with 1 < Vi < D, The vector denotes the 
state where site i is in state Vi. This is a factorized basis of states for the system. Then, p = S{iX} ^ $0 . Let 

V %={yz,Op O^z). (19) 

and 

p> = {**,OO^t)-p<l. (20) 

Thus, p® is equal to |Ot\I>£| 2 times the probability that the state O^ir/IO^^I is in the ground state ^o, with pi 
is equal to |Ot\I>tf| 2 times the probability that the state is not in the ground state. Then J2$(p° + pi ) = 1 and 
e > Tr(|p - pol) > (1 - E*Pe) + E*P*> 80 E*Pv < e/2- Hence, 

^4 < 7^7, (2D 
P 4 < -^r- (22) 

Then, 



Hence, there must exist some w such that 



* mps = O f ^) (23) 

\JP%+P% 

is a normalized matrix product state, by the assumption that O is a matrix product operator. Further, 

P% > 1 
p% +p> ~ l + (e/2)/(l-e/2)) 



\(*o,* mps )\ 2 = -o4-> > 7-777^77—7^ = 1-^/2 + 0(e 2 ), (24) 



so that $ mps is close to the state \I/o- 

Thus, for any e, we can find a matrix product state ^ mps such that Eq. (|24|) holds and such that Z pro j grows 
logarithmically in V with a,n aa ; growing as an exponential of a polylog in V. 

This derivation can be readily generalized to the case of multiple ground states, labeled a = 0...n — 1. Let 

po = n _1 X)™=i ^o) 0^o> an< ^ assume th & t there exists ap = O'O with Tr(/?) = 1 and Tr(|p — Pol) < e - Then, define p° 
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(o) . 



as above and again find an appropriate ^,jj D , so that $ mpi .o = (^/\Jp%, + P% )O^ iSo 1S close to some state 

the ground state subspace. Then, define p\ — po — n _1 *&Q ) (^^\ and define p\ — OpiO^z). One can then find 

a state such that $ mpSj i = (1/ \Jp\g 1 + )0^t« 1 is close to some state in the ground state subspace, with 

(^q 1 -*, ^o " 1 ) = 0. Repeating this n times, one can then span the ground state subspace with a set of matrix product 
states, ^mps,a, a = 0...n — 1. 

We note that in the procedure discussed in this section, the thermal density matrix is introduced simply as a means 
of approximating the projection operator by a local operator. Other approximate projection operators could have 
been used, such as 

1 f°° 

/ dtexp[ifft]exp[-(t/t,) 2 /2], (25) 



for some t q , where the approximation becomes more accuracte, but also less local, as t q increases. In this case, given 
the entropy assumption (fT6|) we would need to take t q of order \og(V) / A.E to ensure that the approximate projection 
operator was close in trace norm to the exact projection operator. 



III. DISCUSSION 



We have shown that it is possible to find systems for which the entanglement entropy between a given subvolume 
and the rest of the system is much larger than expected from the correlation length. However, we have also shown that, 
subject to the assumption (|16p which is satisfied by many physical systems, matrix products give a good representation 
of the ground state even in higher dimensional systems, providing additional reason to consider the use of these states 
as a numerical technique. 

Eq. (|16p has an interesting physical interpretation. If there is a gap and this equation is satisfied, then the system 
is not "glassy" in that at temperatures of order AE/ log(U) the system is in its ground state with probability of order 
unity. Consider, however, the following system, related to an example of Terhal and DiVincenzo: a one-dimensional 
system with D — 3, represented by a spin-1 degree of freedom on each of V different sites. The Hamiltonian is 
- EJ(>S?) 2 - V 2 ][(£f +1 ) 2 -l/ 2 ] + Q-AO E 4 (Sf ) 2 - The ground state has spins with S z = and energy equal to -V/4. 
However, there are 2 V states with each spin having S z — ±1 with energy — V/4 + 1. Thus, this system does not satisfy 
Eq. (HU) for any fixed, ^-independent, c. However, the related Hamiltonian - X)J(Sf ) 2 -l/2][(S; z +1 ) 2 -l/2]+]r t (Sf ) 2 
has the same ground state and does satisfy Eq. (|16|) . In general, for any classical system, meaning that the Hamiltonian 
is a some of operators which are diagonal in some factorized basis, the ground state will trivially be a matrix product 
state. Thus, we conjecture that for any gapped local Hamiltonian it is possible to find a related Hamiltonian with 
close to the same ground state and which satisfies Eq. (|16p and hence has an approximate matrix product ground 
state. 
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the NNSA of the U.S. DOE at LANL under Contract No. DE-AC52-06NA25396. 



APPENDIX A: DENSITY MATRIX FACTORIZATION AND AN AREA LAW 



The goal in this section is to relate the factorization of the density matrix to the entropy of the reduced density 
matrix. Suppose X is an arbitrary set and let Y be the set of all sites i such that dist(A, i) > I for some I. Let B 
denote the set of sites j which are neither in X nor in 7. In this section, we assume that for some state there is 
a bound 

Tr(\pxY - px ®pv\) < e (Al) 

for some e for the given X, Y and derive a bound on the entropy of the reduced density matrix px ■ The case that 
e = was considered by [y], where it was shown that this implies that the density matrix px has at most Z)' B ' nonzero 
eigenvalues. In this appendix, we consider the case of a non-zero e. 
The wavefunction can be written as 

<P„)=^i( a )^)®n y ), (A2) 
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where $xy is a wavefunction on X UY and $b is a wavefunction on the set B, where B is the set of all sites i such 
that i X and i Y and where = (*^ y , ^ XY ) = S a ,(3- Then, 

pxy = Y,\ A ^)\ 2 nv)^XY. (A3) 

a 

Then, pxy is equal to the weighted sum of at most different density matrices ^xy) xy , each of which 

corresponds to a pure state. Define P to be the projection operator onto the space spanned by these D' 5 ' different 
states ^xy- Then, from Eq. (|A1|) . we have Tr((pxY — Px® Py)P) < e so therefore Ti(Ppx O py) > 1 — e. 

The operator px may be diagonalized, so that 

where (^^j^x) = # a ,/3- The index a ranges from 1 to at most Let us order the eigenvalues, so that px(oe) > 

px(0) if a > /?. Similarly, we write py = ^2 a — py (a)^ Y ) (^Y anc ^ again order the eigenvalues so that py(a) > py{(3) 
if a > (3. Finally we denote the eigenvalues of px ® py by ^(7) and also order these eigenvalues. Note that for each 
7> p{l) — p( a )p(P) f° r some a, with a < 7. Since P projects onto a space with dimension at most Z)' s ', we have 

d \b\ d \b\ 

1 - e < tr(Pp x ® py) < ^ p(7) < P x ^' ( A5 ) 

7—1 a— 1 

Therefore, 



2 px(a)<e. (A6) 



Eq. (|A6|) means that the total probability of the system being in any state on set X other than some given set of 
£>I B I states is bounded by e. This is very close to a result for the entropy. Indeed, px has at most D' x \ non-zero 
eigenvalues. Thus, the entropy is bounded by: 

D \B\ D \X\ 

S(px) = -]Tpx(a)log(p Q ) = -J2 Px(a)log(p a ) - ^ p x (a)\og(p a ) < \B\ ]og(D) + e\X\Qog(D) + log(e)). 

a a=l a =D\ B \+l 

(A7) 
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